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Abstract 

Since true stepwise methods are not useful for variable 
deletion, analogs have been developed for use in 
multivariate methods such as canonical correlation analysis. 
These analyses focus on deleting variables that have low 
canonical communality coefficients. Empirical research 
suggests that such strategies may yield results that are 
more replicable across samples. 
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Acceptable Variable Deletion Methods in Canonical 
Correlation Analysis 

Researchers may wonder why variables should be deleted 
in canonical correlation analysis. Perhaps they feel that 
bigger is better. The reason to delete variables in 
canonical correlation analysis is to simplify the analysis. 
There are many reasons to simplify the analysis. The most 
important reason is that the simpler the explanation, the 
more likely it is to be true, therefore the more likely it 
is that the result is replicable. In fact, Thorndike (1978) 
explains , 

as the number of variables increases, the probable 
effect of these sources of [error] variation on 
canonical correlation increases. Therefore, the 
fewer the variables there are in a canonical 
analysis which yields a correlation of a given 
magnitude, the greater the likelihood that that 
correlation is due to real, population-wide 
sources of covariation, rather than sample- 
specific sources, (p. 188) 

As Rim (1972) noted, variable deletion would result in 
more parsimonious solutions, and consequently the solutions 
would be more invariant and generalizable . 

Given the importance of parsimony in solutions, this 
paper presents three variable deletion strategies for use in 
canonical correlation analysis. Conventional stepwise 
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methods are inherently flawed, and cannot be used for this 
or other purposes (Thompson, 1996) . 

Deletion Strategy #1 

The first strategy involves looking at the canonical 
communality coefficients (Thompson, 1980) . Because the 
squared canonical structure coefficient shows how much 
variance the variable linearly shares with the canonical 
variable, and given that canonical functions are perfectly 
uncorrelated, then the sum of all the squared canonical 
structure coefficients across all the functions shows how 
much of the variance in a given observed variable is 
reproduced by the complete canonical solution (Thompson, 

1984) . 

Not only should the canonical communality coefficient 
(h 2 ) be considered in variable deletion, but also the 
squared canonical coefficient (Rc 2 ) . The Rc 2 represents how 
much each function is contributing to the overall canonical 
solution. When a variable is deleted and the Rc 2 for a 
given function stays relatively the same, the result is a 
more parsimonious canonical solution. 

The column labeled h 2 (canonical communality 
coefficient squared) in Table 1 presents the sum of the 
squared structure coefficients, labeled “stru 2 ,” across all 

the functions. Notice that only two of these sums, those 
for variables T16 and T15, are remarkably lower than the 
other variable sums. The Rc 2 s for each of the three 
functions were, respectively: 36.9%, 5%, and 0.9%. Thus, the 
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functions varied considerably as regards to their 
noteworthiness . 

INSERT TABLE 1 ABOUT HERE 



Because in the preceding strategy only the h 2 is 
utilized for choosing which variables to delete, the 
variable with the lowest h 2 , T15, was the first variable 
dropped. Table 2 presents the complete canonical solution 
after variable T15 was dropped. Dropping variable T15 
resulted in very little change in the Rc 2 for each function, 
less than 1% for each function. There was also very little 
change in the function, structure, and communality 
coefficients. Therefore, dropping variable T15 resulted in 
a more parsimonious model. 

INSERT TABLE 2 ABOUT HERE 



But, the resulting solution still left variable T16 
with an h 2 remarkably lower than the others . Table 3 
presents the next iteration in the variable deletion process 
with variable T16 dropped. Dropping T16 resulted in very 
little change in Rc 2 for each function. There was also 
again very little change in the function, structure, and 
communality coefficients. Therefore, the deletion resulted 
in a more parsimonious model. 



INSERT TABLE 3 ABOUT HERE 
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Deletion Strategy #2 

The limitations of this strategy are that the 
contribution of each function is not evaluated until the 
variable is dropped. Another strategy, which considers the 
contribution of each function to the total canonical 
solution, would involve looking at a subset of the h 2 s. In 
the preceding example, the third function was contributing 
very little to the overall solution, Rc 2 = 0.9%. Therefore, 
looking at the subset of just the first two functions may be 

more valuable to a researcher. 

Table 4 presents the complete canonical solution 
excluding the third function. Notice the subset h 2 s . 

Instead of variables T15 and T16 having the lowest of the 
h 2 s, T12 contributed the least amount of variance to the 
overall canonical solution. Therefore, in the new analysis, 
presented in Table 5, variable T12 was dropped from the 
solution. The result was variables that were very close in 
their subset h 2 s . Therefore, the iterative deletion of 
variables with low communalities was terminated. 

INSERT TABLES 4 AND 5 ABOUT HERE 



Although this strategy considers looking at each 
function's contribution to the overall canonical solution, 
it does not consider each variables contribution to its 
respective function. For example, the Rc 2 for Function I 
was equal to 36.9%. The greatest contributor to that 
function was variable T22 . But, variable T22 was not the 
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greatest contributor to Function II. Variable T10 was the 
greatest contributor to Function II. Neither variable T22 
nor variable T10 was the greatest contributor to function 
III, T12 was. As shown previously, Function III contributed 
very little to the overall solution. Therefore, although 
variable T12 was a great contributor to Function III, it is 
a very small contributor when looking at the aggregate. 
Deletion Strategy #3 

This brings about the third strategy in variable 
deletion, a weighted h 2 . A weighted h 2 reflects not only 

the variable's contribution to the function, but also the 
function's contribution to the complete canonical solution. 
This gives a clearer picture of what a variable's total 
contribution is to the complete canonical solution. The 
weighted h 2 for a given variable consists of multiplying the 
Rc 2 for each function times the squared structure 
coefficient for each function and then adding these products 
together for each measured variable or row. This gives a 
better idea of what each variable is contributing. 

Table 6 presents the weighted h 2 for each variable in 
the complete canonical solution. Notice that only four of 
the variables appear remarkably lower than the others, 
variables T10, T12, T15, and T16. Because it had the lowest 
weighted h 2 , T15 was dropped from the solution first. Table 
7 presents the results of dropping variable T15 . Notice 
that the Rc 2 changed very little from the first iteration to 
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the second. 
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INSERT TABLES 6 AND 7 ABOUT HERE 



In the next iteration, presented in Table 8, the next 
smallest contributor to the solution is dropped, variable 
T12 . Notice again the very small drop in the Rc 2 for each 
function. Table 9 presents the next iteration, which 
involves dropping variable T10 from the solution. Again, 
there was a very small drop in Rc 2 for each function. The 
final iteration, presented in Table 10, involves dropping 
variable T16 from the overall function. Likewise, there was 
very little change in the Rc 2 . This final strategy for 
dropping variables deleted four variables considering their 
contribution to the overall solution. Dropping these four 
variables lowers the Rc 2 only 0.6% for the first function, 
2.9% on the second function, and 0.7% on the third function. 
These are negligible differences considering the overall 
canonical solution, and the result is a much more 
parsimonious model, with four less variables than initial 
model . 

INSERT TABLES 8, 9, AND 10 ABOUT 

HERE 



Summary 

When approximately the same amount of variance can be 
reproduced with a larger variable set and a smaller variable 
set, researchers should generally choose the smaller 
variable set. The smaller set is a more parsimonious 
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solution, and therefore is more likely to be true and 
replicable (Thompson, 1984) . For canonical correlation 
analysis, bigger is not necessarily better. Three strategies 
for creating more parsimonious results were illustrated 
using a well-known data set to make the discussion concrete. 
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Table 1 . Final Canonical Solution with Canonical Communalitv Coefficients 
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